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ABSTRACT 


MNece.sery and su ficient conditions ‘or »optinality are given, 


nvex procrammarg problems, without constraint gualivication, 


im. Of a single mathemntacal program, which can be chosen 


hilineer. 


i. Introduction 

This paper iv a seque) to [1°, where optimality conditions 

er (Onvex DYo¢ramming, not requiring constraint quali ication, 
were given in terms >* a family of linear programs, expressina 
the “loci. a!” conlitions (5) and (6) below. 

Hore the same i. achieved by 2 single problem, which depends 
ai) wom positive-de .nite ‘unctions to be chosen. For tne case 
where the constraint functions are strictiy convex in their “actual" 
variabies, tha. characterization of optimality is given in § 2. In 
particular, it as possib.e to characterize optimality by the single 
bilinear procram (AL), given following Example ! below. 

For the convex case, we give a sample result in § 3, char- 


acterizine optimality in the case where tne constraint functions 


are ‘aithfully convex, [4}. 


2. The strictly con sex case. 
: n 
For a civen ‘function f°: R * R, we de'ine its restriction 
f “ as followa. Let “k? ¢ ff, 2, ..-, n} Genote the index set o 


k 


the variables {x ,} on which f° actually depends 


a) 
"k? = : There exist Fn TE i # j, euch that the function 
* . 7 
‘ (€,. eee 5-1" , B41 ee ee &,) ls not a constant}. 


Fur any x ¢ R" the .ubvector Xr. 28 obtained by deleting the com- 


ponent ~ (x5: m4 “k’). The restriction fh) is the fumtion 


°’ ad BY 
2 prara.k *R oftained by restricting #K to a we 
Con.ider the programming problem 
{P) min :°(x) 
k ; . x 
Sth. c (x) af K eP = {1, Le evere pr}. 
Fer 2 @a:. 2b csoiut on x*, a.e., 
ce Mexe) so, FE P, 
we denote tne set o: Binding constraints by 
(2 Pe nw (k: ke P, th(xe) = OC}. 
* chapactestsation of optamalaty as given in t'.e fc . lowing 
Tht. 2 let 
: : k 
ee the prokiem (P) have convex functions {f : k € {0}. P } 


azsumd ditfercntiabie, 


(1:2) “@® be a feasible «oc lutacn of (P) at whach the restrictions o: 


t 2 
the bhandang cos-*raint- se ke PM, re stractly or.vex!, 


a 


-*k be any positive definite sunction, 2i.€. 


’ 


f. 
R on a 


lan a 


k ard’k* 
. (2) > », O #2 eR vn 


k 
@ (0) st ke pe, | 
chen .@ as optimal 2° and oniv af + # OU is tne optima! value o° 


tne program 


lena acsumption is weaker than stract convexity o: 


oP 
& 
functzon.. (7%: « ¢€ WM), unless (kt © (1, ..., n} vor ali ke 


r. 


max @ 
st. 
(4) a® Ve % ee) ey 
(4) a‘ v Bee) + at (de. .) 7oO, Ke p*. 
nr 
d  cland tor directions such tha-, rO<e suifi.aent)y 


ea@sible and 6° (xe +e) < £°¢x*), Thea the 

tir. ity o° x* as equivajenrt to the nonexi tc ce of such d. 
; ° f 

Using the convexity properties of £ and ({f x}, ke P*} 


2 to the non- 


at follows that the optirnelity of x* is equivalent 
existence of d satisfying 
(5) a*y °(m*) < 0 

ity *(xe) = 0 


with equality orly 1° ae, = 0, ke P®*, 


Let «* be non optimal, i.e., let there exist a q satis ying 
(5) and (6). Let 
k 


- A =t » 
en Se ae (RGR) at oKixe) < 0} D. 
Vv 


The i» positive and 


“The details are as in the proof of [1], Theorem 1}. 


(7) a’ yoO(xe) + 5 £6 
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(9) Gt Vekixe) + 5 MUG, | +0, hE PP, 


positive optimal value. 


show.ag that the program (A) hac 


Let the pregran (A) have a positive optimai value, i.., i«t 


the exist a vector 3 and a scalar % satizs ying (7) anu (8). Then 
d* 7 (xe) =< -a< © 
and 
St ock = ky 3 \ , * 
a v (x*) s- vv -) ( dey) $ U, mn € P ‘ 
50 that t k k 
a Vek(xe) = 0 2 5 ( a...) = 0 
= die? =z 0, since e* is 


7 positive ce'inate. 


Therefore 4 catisfics (5) and (6) showing that x* is not optimai. 


l. The convexity assumptions in Theorem !}, ani in re'ated 
re ults he low, can be weaken: 4d in the manner of “3.. 
2 fimalariv, di ferentiability is not e:sentiai here since 
the ce_ult. can be stated .n terms of directional] derivatives. 


3. Since d= 0, + = O is a feasible solution of (A), che 


pliw! vatue o (A) is clearly nonnegative. 1. nonzero, thi. optimai 


vaia a: unbounded. It could be bounded (i: desireau) by 


norm2lizine 4d, «ay 


~ 
wows 
‘ 
ra 
4 
oo 
A 
~ 
— 
~ 
" 
* 
. 
. 
. 
* 
=] 
. 


it j<nou.id be noted that our results hoid in cases wht re 
cla sical optimality conditi ns, [£2] (whach do require come constraint 


- 


qua'i icat.on) fail. This is illustrated in tne following 


Exampie 1. Thr oroblem is 
i -x 
min Or) o@’t « e 2+» x, 
x 
ote (<) ce 1 @ } < £ 
-X., 
(x) > e = red i + C 
2 2 ; } = 
(x) (x, 1)” + x. } 
) -x 
4 x) = a” . + Xx > * € 3 - /- . ° 


- 


Here the sets _k}, ke Pp, are ‘1} = {1), [2] © {3, (3) = (1, 2) 


[aed : ; Lae 
and |<. {l, 2, 3}. The restrictions ¢-* , ke P, are strictly 
: ee P err . ; 
SnViN. The feasible sclutions are 
[Jere 
1?) 
am. CHC Optimti SO.ution 1. x® = 450 » @t wasch point t..c Kunn- 
0 
lTuc’cer condition 


v (xt) + £ » veh (xe) ce do ee 


i , mS 2 z 
Note that the original functions [© , f , and . are not 


strictly convex. 


joes not hold ince vel (xe) = lj, vet (xe) ={0OT, Ve“ (x*) 
] 0 Qe 
3 -<£ 0 
Vi“ (x*) = Ot. WW (x*) =] OF . 
0 1 
Choo.ine the positive definite ‘unctions oX o° Theorem } a: the 
Zz - norm 
“ ie 4 
(z) = & la.1, ke p*, 
i i 
rok (A) ome 
max # 
es 
35 = 5 + qd, +7 <_f 
d + -'q ! $ UY 
} : 
-d + Ig | <6 
2 aii 
a + ! + | < 
2d, ~( ail d,!) © 
- ! ' ! ! ! < 
qd, + e(ida,! + a5! + q, ) 0 
imal lution can found, by inspection, to be a = 6. 
yin. Theorem |, the positive de inite -unctions 
e pP*} sn bc chosen so as te simp'. che .2 
ae much a nossibie. Such choice is the 2. - norm (10) «oc which 


1 1 


un oro lem (A) reduces to the following bilinear progian 


S.t. t 
aA v£°(x*) + + = 0 


t 
d VK xe) +aeX !3.!1 <6, k € p*, 
iefx + 


nolraints, or fixed », are in fact lancar. 
Put tne cave where problem (A) o Theciew }] a@ssune. Lac 


-implicst ‘orm, i.c., & linear program, is where 


ie &- (xe apy 
(33 { 7: af (xe) ¥ 0} © thi, vkoe Pe, 
ax 
J 
r ivwiicnce condition, of the type stucied in £1, .4), smpii 
iy J sat ‘ying (5) cannot satis.y (©) with an equality. 
Tr miy «trict inequalities need be ch ched in (6), ani the 


optimality o x* :. therefore equivalent to the nonconsistency o 


t* y:tem 
(5) a* wo(x®) < 6 
L k 
( ba i v (x*) < oO, k € p*, 


which py che theorem o° tne alternative is equivalent tc tne 


Nn. stency f 
= 1, Vf") = 0 
ie{o} 
(.5) 
d, > 0, at leat one 1, gv, ie{o} «Pp. 
nNoenr be Tratiz John consition. 


The ancidence comditiaon (13) is a special case Go: the 
recularazation conditions studied in "11, under which the con- 
istemy of (75) cha, ‘t:rizes the optimality o x®. Cihest revu- 


4 ion comlitlion: ace the we?) hnown constraint «mali. ications 


8 
«Nac: Qguaranree the nece: sity of the Kuhn-Tucker conditicn. 
The ‘o!lowinw theorem Gives an alternative characteri.ati 
oO: oplhamaliiacy. I. ; roo will be omatted, - ince al mu.. ~mile 


the o63s0° 0. Theorem 1. 


Theo. 2. Urder tne a sumptions o° “heorem 1, the egsitile ~ olution 


* 1 optimal 2, and snly 2:, for every po. atave vo, the op: amas 


Aiue “olliowin: © bimm@ is zero. 
(B.5) mea at Ve (xey 
Ses k 
(8) ao oe" (xe) + 4 wld, ,) -U, bE pe, 
(9) -) | d, - i, / & e ecos Me 
remark. 


', A possib’. advantage o problem (B.7) over the previou: ly 
Cade procacm (A), 2. that the darection ound here i: co steeper 
ie cent. 

«.- Fer any ~ > 0, .et d(v) denote an optimal so.urros = 


(8.5). Cleariy 


t 
mye my 2 dCs) VFO(KE) = dln) 7 PCxe), | 
“hus, tae optimality of <* 1s cquavalent to 
seo: hoe Ge + 9 
( 7) lim ants (ew) OF (e®) oC. 


¢ 
+ *C 


a 


3. <A Special case where only one value ~! +, say + = 1, 


need» ch chica in Theorem 2 is where the function: {-*: ne p*) 


¢ pool cuty 
_*(ee) 
{ jim - 2s 4, ve 
e~ * € 
: - 2 ” . . 3 
“woh @ choice, ia) = & zie was discy sed in “1, Corol fry !.} 
%. The imple t ‘orm that problem (R.+) 24mit., as © .amar 


prmcam. Thas a» obtained by choosing the po: itive de -inice 
func la Ms {>*; k € p* }in (@) as the 2,7 norm ('0). Then 


(R.+) becomes 


(BI. +) min a* ¥ r°rxe) 
; 53 zn .t 0 (xe) o~ la! - t, w e Pr. 
ic” ° 
ad < bal = -e ee . 
1 a5 i. i n 
5. For ~ = C, peoblem (B.-) become. 
(a0) man a® 8 £9 (xe) 


at g Kc xe) <0, * « PF 


-l<«d, <i, if @wl, ceo. Ne 
Thy wot ihet hore .he ytimal value i. zero 
cir aga" gr@qxey © 0 
er » Bb hn-Tucker condition 


Fe k 
er (>) +o = Oh. qv (x®) = 
(59) keP 


which as su ficient for the optimality of x®. 

S. A heuristic procedure for checking th optimality o° a 

iven ea:iblie solution «* is: 

a) Solve the \incar program (B.0). 

b) If its optimal value i» zero then, by the previous 
remark, x® is optima). 

c) If (18) does not hold, solve the linear program (BL.~ ) 
for some somal’ +> 0. 

4) If its optimal value d(w,)* Ve°(x®) as negative then x® 
is nonoptinal, and do) is a direction of discent. 
Otherwie, solve (B.9)) for %, = -2 .- etc. Use a rea- 
sonable stopping rule. 

7. Note that it is possible ‘or (17) to hold, ever though 

i(o)* goO(x®) < 0. To illustrate this we can use any example where 
the iAwhn Tucker conditions do not hold at an optimal point x*. 


Thus or example 1, problew (B.0) becomes 


mn a - a, -d 


3 
$.t. 
d <c 
1 
- a s 
9 0 
-2d, - 0 
+ 
-d #C 
3 
— oR, es & @ Z,. 2. Be 


Th: opiamal solution here d(o)* = (9, 1, 0) with optimal value = -). 


}} 
— % result Jor th. convex case. 
“onsadvr again the problem 
'r) man “¢x) 
eenme k 
(x) *©0O, k e€P, 
where the Cunction ie*: x» € {0} * Pp ) are convex, but without 
urther assumptions on the restrictions efk), In fl, *57 it was 
shown Laat at an optimal .oclution x®, the lo:sical condition (6) 
r come 
(26; i U“(xe) <0, 
. & eo 
wit cquality only i JED, KEP, 
° K 
wnere D, is “hr cone of dJirec ; of constenc es a®, 
defined by 
s - ; - 
(21) D,° = (4235 > 0 DM (xe + ad) = (xe), Vio € 0, 41). 


Geom cally chas come is neither polyhedral nor convex, see, €.4. 
che x@mcs an “i, .57. However, this cone is quite manaceati. 


“7 catia ampostenrt family of conve: fun cion: 


Sop 2 Mae ey eat ee 


n 


a’: R™ *R is a strictly convex function 


4 5 
A: Ro R™ is a lancer trans lormatio: 


“ r™ 
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These “unctions are the faithfully convex functions introduced and 
.tud:ed by Rockafe’ltar in [47, 57. 


For the function e given 


by (22) and subject to the above assumptions the cone a, As Simply 
(23) 


mn = ee aR 


the nujl space o° the (m+ 1) X nm matrix * . andependertiy of x*®. 


Thus cin analogous result to Theorem i i+ 
Thecren 3. tet 
(a) the »:oblem (7) 


have a c nvex objective ‘unction [© and convex 


con .raint functions (c*; ke P} of th type (22), a) 
Sum 2 di ferentiable. 
& 1 na aed 
(ai) o*, y™ * *R be any positive de‘inite functions, 


REP. 
Then a lCearible 


solution x® is optimal if, and only i 
~ = 0 is the optima) value of the problem 
ma. ~ 
Bete 

a* VWe9(xe) + » 80 


a* ge*ixey + ad ( d) <6 


Proc 


Poliows from (20), (°3) as in the proof of Theorcm i. 


g 


The rem@inane results of §2 can similarly be adapt«. to the 
COMVERXR CAabe. 
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